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Abstract 

Polyhedral control Lyapunov functions (PCLFs) are exploited in finite-horizon linear model predictive control formulations in order 
to guarantee the maximal domain of attraction (DoA), in contrast to traditional formulations based on quadratic control Lyapunov 
functions. In particular, the terminal region is chosen as the largest DoA, namely the entire controllable set, which is parametrized 
f--^ by a level set of a suitable PCLF. Closed-loop stability of the origin is guaranteed either by using an "inflated" PCLF as terminal 
{S) cost or by adding a contraction constraint for the PCLF evaluated at the current state. Two variants of the formulation based 
£^on the inflated PCLF terminal cost are also presented. In all proposed formulations, the guaranteed DoA is always the entire 
^ controllable set, independently of the chosen finite horizon. Closed-loop inherent robustness with respect to arbitrary, sufficiently 
small perturbations is also established. Moreover, all proposed schemes can be formulated as Quadratic Programming problems. 
Numerical examples show the main benefits and achievements of the proposed formulations. 

t-H Keywords: Model predictive control, control Lyapunov functions, stability, inherent robustness. 



ZZ. 1- Introduction 
CO 

CZ) Model predictive control (MPC) algorithms solve a finite- 
i ^ i horizon optimal control problem (FHOCP) that includes con- 
straints on states and inputs over the predicted trajectory. The 
*~ I first input of the optimal control sequence is injected into the 
system, and at the successor decision time the FHOCP is solved 
starting from the new current state. In order to ensure nominal 
stability of the origin of the resulting closed-loop system sev- 
eral approaches can be used, e.g. inclusion of a suitable termi- 
nal constraint and/or a suitable terminal penalty |Q] Ch. 2], or 
enforcing the contraction of a suitable control Lyapunov func- 
C^l tion (CLF) CUD- When a terminal constraint is enforced, there 
' T ~~ 1 is a well defined set of initial states for which the FHOCP is 
;> feasible, which is the set of states that can be driven to the ter- 
minal region in N steps, where N is the finite horizon. Such 
a set represents the domain of attraction (DoA) of the con- 
C3 trailer. The terminal region is often computed assuming (im- 
plicitly) that a linear state feedback control law is employed 
within such region [4 5 |. For linear systems, explicit computa- 
tion of the maximal terminal region is possible (§). A particular 
case of terminal region is represented by a terminal equality 
constraint QUO. The inclusion of a terminal constraint, how- 
ever, also has some disadvantages, typically associated to the 
fact that the DoA can be small if a short horizon is used. In 
fact, it follows trivially that the DoA can be enlarged by in- 
creasing the prediction horizon. Clearly, longer horizons imply 
higher computational times, and therefore a trade-off between 
size of DoA and computational limits is usually necessary. 

Terminal penalties are usually employed to take into ac- 
count (exactly or an upper bound to) the infinite-horizon cost- 



to-go 15] ID . In this way, the optimal value function of FHOCP 
can be shown to be a Lyapunov function for the closed-loop 
system, thus implying stability of the origin |9|. Moreover, for 
linear systems with a quadratic cost function, if the terminal 
penalty is chosen as the solution of the Riccati equation, it is 
possible to show that the FHOCP yields a solution identical to 
that of the corresponding infinite-horizon controller ifTOl HP . 
Alternative formulations with neither terminal stabilizing cost 
nor terminal constraint are also possible (see |[T2l Ch. 6] and 
references therein). 

The objective of this paper is to propose linear MPC formu- 
lations with the following features: (i) the DoA is the maximal 
controllable set irrespectively of the horizon; (ii) the resulting 
FHOCP can be posed as a Quadratic Programming (QP) prob- 
lem; (iii) for a subset of the DoA the FHOCP yields a solution 
identical (or similar) to that of the infinite-horizon controller. 
To achieve the above goals, we exploit the properties of poly- 
hedral control Lyapunov functions (PCLFs) in the formulation 
oftheFHOCPs. 

The use of PCLFs for the constrained stabilization of a lin- 
ear system traces back to l4"l [T3ll . A thorough survey on poly- 
hedral functions for system analysis and control synthesis is 
[14|. The main advantages of considering PCLF -based stabi- 
lization schemes for linear (uncertain) systems are that: (i) the 
maximal (possibly asymmetric) controllable set can be approxi- 
mated with arbitrary precision; (ii) under "polytopic" model un- 
certainties, robust stabilization is equivalent to stabilization by 
means of a PCLF lfT5l[T6l . From these points of view, polyhe- 
dral functions are basically equivalent to composite-quadratic 
functions [17). Moreover, constructive algorithms for PCLFs 
are based on (iterative) linear programming (LP) [ 18 1. 
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To the best of the authors' knowledge, only a few contribu- 
tions are available in the literature regarding the use of PCLFs 
in linear (receding-horizon) MPC formulations. In 1 19, 20 1 in- 
finity norms, namely symmetric polyhedral functions, are em- 
ployed both in the stage cost and in the terminal cost. On the 
contrary, ||2] [3] proposed contractive MPC schemes based on 
quadratic control Lyapunov functions (QCLFs). 

The paper is organized as follows. The problem statement 
is presented in Section [2] together with the basic technical pre- 
liminaries. Several novel MPC formulations based on PCLFs 
are proposed in Section [5] while nominal and robust stability 
analysis is discussed in Section |4] Numerical implementations 
of the proposed MPCs are presented in Section [5] Simulation 
results are shown in Section |6] The achieved results are sum- 
marized in Section|7l 

Notation. Given vectors x, y, the inequality x < y is intended in 
a component-wise sense. / denotes the identity matrix. Given 
a symmetric matrix A, the symbols A > and A > mean 
positive definite and semi-definite, respectively; moreover, Aa 
denotes its largest eigenvalue. N is the set of natural numbers; 
M, M>o and M>o denote the sets of real, strictly positive real, and 
non-negative real numbers, respectively. B denotes the unitary 
ball in W. The interior of a set S is denoted by int(S ). 

2. Problem statement and technical background 

We consider discrete-time linear time-invariant systems: 

x + - Ax + Bu, (1) 

in which x e W and u e W" are the state and input at a given 
time, and x + e W." is the successor state. States and inputs are 
subject to constraints 

x(k) eXcR", u(k) e U c W" Vk e N, (2) 

where X and U are compact and convex polyhedral sets con- 
taining the origin. In particular, we assume that X contains the 
origin in its interior, while this is not necessarily required for U. 

Assumption 1. The state x(k) is measurable at each sampling 
time k eN, and the pair (A, E) is stabilizable. 

We use u to denote a possibly infinite control sequence \u(k) \ 
k G N), and we use <p{k; x, u) to denote the solution to ([1} if the 
state at time is x and the control sequence is u. Let Xco £ X 
be the maximal controllable set, defined as 

Xcc = {x e E" | 3u : u(k) e U, (f>(k; x, u) e X VA: e N, 

and lim <p(k; x, u) = 0}. 

k— >oo 

For any x e A"oo, we can define the set of infinite-horizon ad- 
missible control sequences as 

U^x) = {u | u(k) e U, (p(k; x,u) e X V/t e N, 

and lim <p(k; x, u) = 0}. 

k— >oo 



Assumption 2. contains the origin in its interior. 

The control objective is the state-feedback stabilization of 
(fTJ, starting from any x e Xca, trying to minimize the quadratic 
performance cost 

CO 

Voo(x, u) = ^ {(<p(k; x, u), u(k)), 

k=0 

in which €{x, u) = x T Qx + u T Ru where Q > 0, R > 0. Thus, we 
consider an infinite-horizon optimal control problem (IHOCP): 

PooO) : minV M (x,u) s.t. u e tl^ix). (3) 

u 

Let u°(x) be the optimal solution of the problem Pco(x) and 
k(x) == u°(0;x) its first component. Moreover, let V^ix) == 
Voo(x, u°(x)) denote the optimal value of problem P M (x). 

2.1. Preliminaries on polyhedral control Lyapunov functions 

Polyhedral control Lyapunov functions (PCLFs) are partic- 
ularly suited for the constrained stabilization of ([TJ. In fact, in 
the setting of linear systems subject to polytopic model uncer- 
tainties, QCLFs give only sufficient conditions for the robust 
stabilizability. Conversely, the existence of polyhedral contrac- 
tive sets and their associated PCLFs is a necessary and sufficient 
condition for the robust stability of (constrained) uncertain lin- 
ear systems Ifl4l . A generic polyhedral function of the second 
order [ 17 | can be expressed as: 

V p (x) = (max(Fjc)) 2 = |max{F,jc}j (4) 

where I,. = {l,2,...,r}, F; € K lx " is the i"' row of F, and the 
matrix F is such that max(Fx) e R >0 Vx e W \ {0}. 

Proposition 3. As V p (-) in Q is homogeneous of the second 
order, there exist positive constants a\ , ai such that: 

a x N| 2 < V p (x) < a 2 \\x\\ 2 Vx e W. 

It is worth mentioning that, without essential loss of gen- 
erality, also smoothed PCLFs (via high-order norms) EH are 
a universal class of functions for the stabilizability of (con- 
strained) uncertain linear systems. Moreover smoothed PCLFs 
(unlike standard ones) allow the derivation of explicit formulas 
for the stabilizing controller [21 J. The fundamental advantage 
of PCLFs is that the associated polyhedral domain of attraction 
(DoA) is particularly flexible to cope with control/state con- 
straints since they are capable to approximate the largest DoA 
with arbitrary precision 1 14 1. Therefore, it can be assumed that 
the maximal controlled invariant set of ([1} is given by: 

^={ieK"| Fx < lj , (5) 

where l r e K r is a vector of all ones [M 



1 With a slight abuse of notation, by "maximal controllable set" X m we mean 
that for any given e > we can find F such that the size of the controllable set 
<Voo j5j is e-close to the "true" maximal controllable set. 
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The computation of the PCLF with the largest controlled 
DoA can be performed via sequential linear programming (LP), 
both for discrete-time systems lfT31l and "equivalently" for the 
class of continuous-time systems fl6| . Note that the procedures 
in ll22l . |[l"8l compute the maximal (robust) controlled polyhe- 
dral set associated to an a-priori fixed decay rate A e [0, 1). The 
following Lemma holds true. 

Lemma 4. Let V p (-) be the PCLF shaping the controlled set 
Xoo |5])- Then, for any x e Xoo there exists u e U such that: 

Ax + Bu e Xoo, V p (Ax + Bu) < A 2 V p (x), and \\u\\ < c\\x\\ 

hold true for some c e IR>o. Moreover, the above condition 
V p (Ax + Bu) < A 2 V p (x) is equivalent to 

F(Ax + Bu) < Amwt(Fx)\ r . 

Proof. The fact that there exists u e U such that Ax + Bu e 
Xoo and V p (Ax + Bu) < A 2 V p (x) hold true follows from the 
definition of CLE To show that such u satisfies ||«|| < c||x||, we 
recall that such u is a piecewise-linear function of x lfT6l . i.e. 
u - K^x where 7f (/l) is the state-dependent gain of a linear 
controller that guarantees a /l 2 -decay of V p (-) in a given subset 
of Xoo . As the number of different gains K {h) is finite, we define 
c = max A {||^ (/l) ||} and obtain that ||m|| = < c\\x\\. The last 

statement follows directly from □ 

Lemma 5. There exists a positive constant aj such that: for 
any x € Xoo, there exists ueU satisfying Ax + Bu € Xoo and 

V p (Ax + Bu) - V p (x) < -a 3 \\x\\ 2 . (6) 

Proof. From Lemma [4] for any x e Xoo, 3m e U such that: 

V p (Ax + Bu) - V p (x) < -(1 - A 2 )V p (x) 

<-(l-AVilW| 2 <-a 3 |W| 2 , 

holds true for any < a 3 < (1 -A 2 )ai. □ 

Given a candidate polyhedral region X, the minimum ad- 
missible decay rate A can be computed by solving lfl4ll : 

min A s.t. < A < 1, Wu > 0, 

A,U,W 

AX + BU = XW, JJW = /UJ, (7) 

where the v columns of matrix X e K" X1 ' are the v vertices of the 
given polyhedron X, W e R vXv and, as a result of the optimiza- 
tion, the columns of U e M. mXv are the admissible controls for 
the vertices of the polyhedron ||4), Ifl4ll . A solution to (|7| exists 
if and only if the given polyhedron is controlled invariant. 

2.2. Basic finite-horizon constrained formulation 

The basic sub-optimal solution of the constrained stabiliza- 
tion problem Q is the following finite-horizon constrained for- 
mulation. Let u be a finite-horizon control sequence of length 
Af, and let <p{k; x, u) be the corresponding solution to ([TJ at time 



k for the initial state x(0) = x. Define the set of admissible 
initial states as: 

X N = {xe W I 3u : u(k) e U, 

(p(k; x, u) e X Mk e N 0: jv-i , and (f>(N; i,u)eX/), (8) 

in which Xy c X is a terminal set later defined. For any x e X^, 
define the set of finite-horizon admissible control sequences as 

<U N (x) = {u I u(k) e U, <f>(k;x,u) e X Mk e Nq-m-u 

and<p(N;x,u) eX f ), (9) 

and the cost 

A<-1 

V N (x, u) = Vf(<p(N; x, u)) + Y e(4>(k; x, u), u(k)). 

Consequently, the basic finite-horizon optimal control problem 
(FHOCP) considered is 

¥ N (x): mmV N (x,n) s.t. u e 14 N (x). (10) 

u 

Proposition 6. The following property holds true: 

X f c Xi c ■ ■ • c X N c • ■ • c Xoo £ X. 

Remark 7. In order to ensure exponential stability of the ori- 
gin of ([T]), the cost function V/Q must satisfy the invariance 
condition that for any 1 e X/, there exists i/eU such that: 

Ax + Bue X/, and V/(Ax + Bu) - V/(x) < -t{x, u). 

For instance, a common choice IfTUl fTTTl for such a function is 
Vf(x) = x T Px, where P > is the (unique) positive definite 
solution to the discrete-time Algebraic Riccati Equation (ARE) 

A T PA -P + Q- A T PB [b t PB + /?)" B T PA = 0. 
Several options are available to construct X/. One choice is 

X/ = {jceX| Vf(x) < a) c Xoo, (11) 

for some a e M>o, which denotes an ellipsoidal set (possi- 
bly maximal), associated to the shape of the Riccati-optimal 
QCLF x T Px, such that for any x e Xf, the associated (uncon- 
strained optimal) control is admissible, i.e. u = Kx e U, with 
K = - (B T PB + R)' 1 B T PA. Alternatively (23j|6), one can de- 
fine Xy as the maximal constraint-admissible invariant set for 
the autonomous system x + — (A + BK)x, which is generally 
described by a (possibly large) number of linear inequalities. 

Remark 8. When the terminal constraint <f>(N;x,u) € Xy is 
omitted from the definition of 11n(x) but the solution to the 
FHOCP ( fT0l >, u°, is such that cf>(N;x,u°) e X/ holds, then it 
is possible to show that the FHOCP ([10) and the IHOCP Q 
yield the same solution [24. [77j] 1771/ . 

Remark 9. The choice of the Riccati-optimal QCLF is admis- 
sible only ifU contains the origin in its interior. 
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In fact, if U contains the origin on the boundary, we would have 



{0}. On the other hand, such assumption is not necessarily 



required in our problem formulation. This further motivates the 
investigation of (asymmetric) PCLFs and consequently PCLF- 
based MPC schemes, especially for short or moderate control 
horizons, as discussed later on. A valid QCLF for the case in 
which U contains the origin on the boundary is discussed in 
112511261 . which yields the optimal solution to ((3) in the limit of 
large control horizon [26|. 

3. Proposed MPC methods 

In this section we show how to exploit both the PCLF shap- 
ing the maximal controlled DoA and the Riccati-optimal QCLF 
in the FHOCP. In particular, the polyhedral function can be used 
as a weighted terminal cost or as a guaranteed decay constraint. 
We define the set of admissible initial states as: 

X p N = {xeW\3\i: u(k) e V, 

4>(k; x,u) e X \fkeN 0:N -u and 0{N; x,u) e X x }, (12) 

and, for any x e X P N , the set of admissible control sequences is 

H p N {x) = {u | u(k) e U, <p(k; x, u) e X V/t e N 0: jv-i, 

and<f>(N;x,u) e X^}. (13) 

We first present a number of supporting results. 

Lemma 10. The following property holds true for any N e N: 

Xn c X p n = Xoo- 
Moreover, for any x € X^i there holds: 

V N {x) c <U p N (x). 

Proof. From ([T2jl and Q, (13), inclusions X N c X P N and 
Kn{x) £ H P N (x) trivially hold because X/ c X x by Proposition 
[6] Moreover, X P N Q Xoo holds as X m is the largest controllable 
set. Thus, X P N 2 Xoo has to be proved for any )VeN. Since 
X p x 2 • • • 2 X p 2 X\ 2 X p y it is sufficient to show that X p 2 
X^. From ([12]): X p = {ieR" 0(0; x, •) = x e X^} = Xoo- □ 



Lemma 11. For any x e Xoo and B satisfying 



b>b* = 



An +C Z Ar 



a 3 



(14) 



there exists an input «eU satisfying (Ax + Bu) e Xoo and 

BV p (Ax + Bu) - BV p (x) < -t(x, u). (15) 

Proof. The fact that, for any x e Xoo there exists u e U such 
that x + — Ax + Bu e comes the control invariance of Xoo ■ 
Condition ( fT5| trivially holds if x = because we can choose 
u — e U and hence x + - 0. In view of Lemma [4] and (6| 
in Lemma [5] there always exists u e U such that: BV p (x) - 
BV p (Ax + Bu) > a 3 B \\x\\ 2 > (A Q +c 2 A R ) \\x\\ 2 > t{x, u) holds for 

an yj e>/r = ^^. □ 



We next present the two novel PCLF-based formulations, and 
then discuss two variants of the first one. 



3.1. MPC 1: PCLF-based terminal cost 

As Vp(-) in Q is a valid PCLF in the whole controllable set 
Xoo, it can be used as terminal cost. We introduce a weighting 
factor B e M > o and define the finite-horizon cost: 

N-l 

V Nfi (x, u) = BV p {<p(N; x, u)) + ^ e(<f>(k; x, u), u(k)), 

so that the FHOCP consequently is 

P^W : minViv^u) s.t. ueW p N (x). (16) 

Remark 12. Problem ( |T6] > is well defined for any Xoo- 
Let V^Jx) denote the optimal value of P^ N {x). As discussed 



later in Section |4] if B is chosen according to Lemma 1 1 



sta- 
bility of the origin of the closed-loop system can be proved by 
showing that V^(-) acts as a Lyapunov function. 

3.2. MPC 2: PCLF-based decay constraint 

Let A G [0, 1) be the guaranteed decay rate of the PCLF 
(of the first order) max(Fx) |18|. From Lemma |4j for any 
x € Xoo there exists an admissible control u e U such that 
max( F{Ax + Bu)) < Amax(Fx). Here we propose the follow- 
ing FHOCP: 

P^(x) : min V N (x, u) s.t. u e V P N (x), 

max(F0(l;x,u)) < Amax(Fx), (17) 

where, we notice that in Vn{x, u) we use V/(x) = x T Px with the 
Riccati-optimal QCLF. The additional (linear) decay constraint 
max(F0(l; x, u)) < Amax(Fx) is added to always guarantee a 
strict decrease of the function V p {-), that is the one shaping Xoo 
itself, along the closed-loop trajectory. 

Remark 13. Problem P^ ( fTTj i is well defined for any x e Xoo- 
Given any x e Xoo, we define the set of admissible inputs as: 

U A N (x) = {u e tl P N (x) | max(F(p(l; x, u)) < Amax(Fx)] , 

and, for any N e N, we obviously have that H^(x) c U p N {x). 

3.3. Two variants of MPC 1 with variable terminal cost 

In view of the knowledge of both the PCLF V p (-) with max- 
imal controlled DoA and the Riccati-optimal QCLF V/( ) with 
IH optimal performance, a dual-mode variant of MPC 1 is here 
proposed. We first solve the following problem, which is sim- 
ilar to Pn in ( fl0l >, but has a less stringent terminal constraint 
4>(N;x,u) e Xoo instead of (p(N; x,u) e Xy, i.e.: 



Vn(x) 



min Vn(x, u) 

ii 



s.t. u e W' N (x). 



(18) 



Let u (jt) be its solution. If 4>(N; x, u°(x)) e X/, in light of Re- 
mark[8j we have that u l \x) is the optimal solution to the IHOCP. 
If, instead, tp(N; x, u°(x)) i Xy, we solve problem P^(jc) in ( fTB} . 
The above dual-mode controller will be referred to as MPC la. 
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Remark 14. MPC la is well-defined for any x e Xoo. 
Remark 15. A dual-mode variant is also suited for MPC 2. 



From the formulation W N ( |T6| l it is clear that the larger B, 
the smaller the effort on minimizing the stage cost £{■). Thus, it 
may be desirable to use the smallest admissible value for B. At 
each x e Xc„, we can compute such smallest admissible B as 



Aq + C 2 A R 

ai(l -A*(x) 2 )' 



(19) 



where A*(x) is the minimal admissible decay rate for the PCLF 
Vp(-), at given x, and it is given by the solution of (|7), where 
X, namely X(x), are the vertices of the polyhedron {y e Xcc I 
max(Fy) < max(Fx)} having the current state x on its boundary. 
Therefore, we consider the cost function 



N-\ 



V W )fc u) = 8*(x)V p (<p(N; x, u)) + J] l{<p{k- x, u), u(k)), 
and define the FHOCP as 



k=0 



r (x): minVNj3*(x,n) s.t. u € U'^x). 



(20) 



The above state-dependent terminal cost formulation will be re- 
ferred to as MPC lb. 

We notice that the weight f3*(x), present in the terminal cost 
B*(x)V p (-) of the cost function Vnj3*( X ), decreases as the state x 
approaches the origin. This means that the optimization prob- 
lem P^, (x) ( f20l > weighs more the stage cost as ||x|| decreases. 
The result is similar to having a non-homogeneous control Lya- 
punov function whose shape is close to the one of V p (-) far from 
the state-space origin, while close to the locally-optimal one 
close to the origin ll27l l28l . 

Remark 16. Problem P?, (|2"0"|i is well defined for any Xoo- 



4. Stability Analysis 

In this section the stability results are provided for the pro- 
posed PCLF-based MPC formulations. From now on, let u^(x), 

u° A (x), u°(x), Up+ix) be the solutions of the problems P^,(x) ( |16) , 

P^(jc) ([17]), P N (x) ([T8), P^(x) ((20]) respectively, and let Kp{x) = 
Up(0; x), k^(x) = u° A (Q;x), k(x) = S°(0; x), Kp+{x) = u ( ^(Q;x) be 
their first components, respectively. 

Lemma 17. For any B satisfying condition ( |14| > of Lemma [77] 
and N e N, the following inequalities hold for any x e Xoc,: 

Vt(x)<---<V° N+lfi (x)<V° N /x). 

Proof. We first prove the inequality VjJ +1/3 (x) < V^(x) for any 
iVeN. Let n" (jt) := (w°(0; x), k°(1; x),..., u°JN-l;x)) be the 
optimal solution to problem P^(x). Let = (p(N; x, u° N/3 ) e 
Xoo- From Lemma jTTJ choose any u* e U such that (Ax° N p + 
Bu*) e X x and BV p (Ax° N + Bu*) + e(x% ,u*) < BV p (x°). 



Define the following candidate sequence for problem P^, +1 (x): 
Ua'+i.s = ( M jj(0; x), k2(1; x), . . . , u l p(N - l;x), u*) and notice that 
n N+\fi e ^n+\^- Since 1%+^ is not necessarily the optimal 
input sequence for problem P^ +I (x), we have that: 



V°Jx)-BV p (xl B ) + £(x NB ,u*) + BV p (Ax° NB + Bu*) < V° NB (x) 



To prove V° (x) < V^{x), we note that the sequence {V^(jc)} 
is monotonically non-increasing with N and bounded below by 
0. Thus, it converges to some point V^^x). We can write: 



N-l 



Vi/x) = Urn V° N /x) = Hm £ £(<f>(k; x, u° N /x)), u° N /k; x)) 
+ limBV p (<f>(N;x,u° N Jx)) 

N—>co ^ 
N-l 

> Um J] {{cp{k; x, u° Nfi (x)), u° NJ3 (k; x)) 

k=0 

CO 

> £ ((4>(k; x, u°(x)), u\k; x)) = V° (x), 

jt=0 

from which the inequality V° (x) < V^^x) follows V/V e N. □ 

Corollary 18. There exist positive constants j\ , j2 such that: 

7i IWI 2 < V%(x) < T2 |W| 2 . (21) 

Proof. From Lemma |l7| we have V°(x) < V^(x) < V®p(x) == 
BV p (x). The optimal cost x T Px for the unconstrained system ([TJ 
obviously satisfies x T Px < V^(x). Therefore, from Proposition 
[3| it follows that: x T Px < V% fi (x) < Ba 2 \\x\\ 2 , from which ([21} 
trivially follows for some j\ , 72 e K>o- D 

4.7. Nominal stability results 

We use the following notion of exponential stability (ES). 

Definition 19 (Exponential Stability). Let if/(k; x) be the solu- 
tion at time k of the difference equation x + — f(x), with initial 
state x(0) — x, and let /(0) = 0. 77ie origin of x + — f(x) is ex- 
ponentially stable (ES) on the set X £ R" if there exist b e R>o 
and A € (0, 1) such that for any initial state x G X there holds: 

xftik; x) e X, \\ifr(k; x)\\ < bA k \\x\\ Mk e N. 

Theorem 20 (MPC 1). For any B satisfying condition ( fT4] i of 
Lemma 
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the origin of x + = Ax + Bk^(x) is ES on X a 



Proof. This result can be proved by applying standard MPC 
stability results [ 1 , Thm. 2.24, p. 123] and recalling the results 
of Proposition[3] Lemma 1 1 and Corollary[l8] □ 



Theorem 21 (MPC 2). The origin of x + = Ax + Bk a (x) is ES 
on Xoo- 



Proof. The closed-loop evolution can be written as: ifr A (k + 
\;x) = Aif/ A (k; x) + Bic^^h; x)) = <p(l;^ A (k;x),n° A (t// A (k;x)). 
Thus, the decay constraint in (T7\ implies that if/ A (k; x) e Xoo 
and max(Fi^ / i(fc; x)) < A k max(Fx) Vk G N. From Proposition 
[3] we have 

V^T \\<JfA(k; x)\\ < mzx(Fil/ A {k; x)) < A k max(fx) < A k y[a~ 2 \\x\\ , 
which implies 

M A (k;x)\\< ^ a2a - l A k \\x\\ V^N. 
Therefore, the origin of x + — Ax + Bk a (x) is ES on Xoo- □ 

In the proof of next theorem, we consider the set of initial 
states for which the solution to Y N {x), which has terminal con- 
straint tp(N;x,vi) G Xoo, also satisfies the terminal constraint 
<p(N; x,u°) eX f , i.e.: 

X N = [x g Xoc I 4>(N; x, u°) g X/}. (22) 

Remark 22. X/ c X N c X N c Xoo for any iVel 

Theorem 23 (MPC la). Let k s (x) = k(x) if (f>(N; x,u°) g X /; - 
k s (x) = Kp(x), otherwise. Then, for any B satisfying condition 



11 the origin ofx + = Ax + Bk s (x) is ES on X a 



( |14[ ) of Lemma 

Proof. We observe that if i// s (k; x) G Xn, then i// s (k + T, x) e <Yjy 
because, for any jc G Aa?, a:. ? (jc) = fi (jt;) = is the optimal 
infinite-horizon control law. This also implies that Xn is in- 
variant for the closed-loop system x + — Ax + Bk s (x), and that 
the origin of x + — Ax + Bk s (x) is ES on origin Xn, i-e. we 
have: ||^(&;*)|| < M*IMI for all k g N, jc g X n and some 
£>i G E>o and A\ G (0, 1). Assume that the initial state satisfies 
x G Xoo \ Xn, otherwise the proof is complete. For all initial 
states x 6 Xoo \ Xn, it follows that K s (x) = Kp(x). Thus, accord- 
ing to Theorem|20j there exists B* such that, for any B > B*, we 
have: ||t^ s (£; x)|| < b 2 A k \\x\\ for some b 2 G R >0 and A 2 G (0, 1) 
as long as tf/ s (k - l;x) G X^ \ Xn- As Xoo is compact, there 
exists a finite time k* £ N, k* > 1, (dependent on jc) such 
that ^(fe* — 1; jc) G A" 00 \ Xn an d >^s(k*',x) g <Yat. Further- 
more, if/ s (k; x) G for all k > k* because Xn is invariant for 
x + — Ax + Bk s {x). As a consequence, for any k < k* we have: 

ll^(*;x)ll<M^IMI, 



whereas for k > k* we have: 



||iMfc;x)|| < MT ll^(f ;jc)II < Mf M2 IWI- 

Finally, if we define A = max]/^, A 2 } and Z? = maxjfoi, b 2 , b\b 2 ], 
it follows that for any x G Xoo the conditions: t^ s (&; x) G Xoo 
and ||(/r. s (/t; < bA k \\x\\ hold for all teN. □ 

Theorem 24 (MPC lb). The origin ofx + = Ax + Bk p * (x) is ES 
on Xoo- 

Proof. For any x e Xoo there exists u G U satisfying Ax + Bu 6 
Xoo, because of the control invariance of Xoo, and 

B*(x)V p (Ax + Bu) -B*(x)V p (x) < -£(x, u), 

as B*(x)V p (x) -B*(x)V p (Ax + Bu) > B* (x)a 3 (x)\\x\\ 2 = (Aq + 
c 2 ^ R )||x|| 2 > l(x, u) in light of {[9) and a 3 (x) = a x {\ - A*(x) 2 ). 
Then, follow the proof of Theorem 20 □ 



4.2. Inherent robustness 

We briefly discuss further properties of the proposed PCLF- 
based MPC algorithms about inherent robustness [29 , 30]. In 
the sake of space, we only focus on MPC 1. For robustness 
analysis we assume that the true system is affected by an un- 
known bounded disturbance d G T> c W; thus, it evolves as: 

x + - Ax + Bu + d. 

Moreover, we consider the case in which the state is not mea- 
sured exactly, i.e. the measured state is x m = x + e where 
e 6 S c W is an unknown bounded noise. Hence, MPC 1 
computes v&(x m ) and implements Kp(x m ), rather than Kp{x). The 
resulting closed loop can be described as a difference inclusion: 

x + G F ed {x) = {x + G W I x + = Ax + Bk p (x + e) + d, 

with deD,eeS}, (23) 

because d and e are unknown. Let iff e d(k', x) be a solution of 
the closed-loop system ( f23| for the initial condition x{0) = x. 
We recall the following definition of Strong Robust Exponential 
Stability BP adapted to the present case. 

Definition 25. The origin of ( |23| ) is strongly robustly exponen- 
tially stable (SRES) on a compact set C c Xoo, G int(C), if 
there exist scalars b G R>o and A G (0, 1) such that the follow- 
ing property holds: given any e G IR>o, there exists 5 G R>o 
such that for all sequences {d(k)\ and {e(k)} satisfying 



\\d(k)\\<6and\\e(k)\\<6 Vk G N, 



(24) 



and all x G C, it follows that 



Xm (k) = x(k) + e(k) G Xoo, x(k) G Xoo, Vieff, (25a) 

||^(*;jc)||<M*|MI + C vfceN - (25b) 

Remark 26. In SRES, condition ( |25a| > requires that the con- 
troller remains feasible at all times for all sufficiently small per- 
turbation sequences {d(k)} and {e(k)}. 

We first prove the following useful results. 
Proposition 27. V^^(-) is continuous in int(A' 00 ). 

Proof. The result follows from (29] Prop. 12], EU Rem. 27]. 

□ 

Lemma 28. For any p G R>o, there exists 5 G ]R>o such that: 
for all (x, e, d) G Xoo X SB x SB satisfying x m = x + e € Xoo and 
F e d(x) C Xoo, the condition 



m ™ , K/ x+ ^ ^ max {^>r^jj(x)} 



x*eF rJ (x) 



(26) 



holds for some y G (0, 1). 



Proof. From standard stability results [1, Thm. 2.24, p. 123] 
and recalling the results of Proposition[3j Lemma 1 1 and Corol- 
laryfls 1 
tion Tor 



we have that V^„(-) is an exponential Lyapunov func- 
the nominal closed-loop system x + — Ax+Bk^(x). Thus, 



given the measured state x m — x + e e A M , the nominal succes- 
sor state x + = Ax m +BKp(x m ) satisfies: V^Jx + ) < fV^Jx m ), for 
some y e (0, 1). Choose any y e (7, 1) and define p = fx(y—y) € 
K>o. We notice that x + - x + — Ae - d. By continuity of VjJ„(-), 
shown in Proposition 27 we can choose 6\ e K>o such that for 
all (x, e, d) e x 6{B> x 8{M> satisfying x m — x + e e X m and 
any x + e F e( j(x) c X x there holds: 



(27) 



By continuity of V^g(-). we can also choose 52 £ R>o sucn that 
for all (x, e) e A M x ^B, the following condition holds: 



(28) 



Vl fi (~x + ) < yV Nfi (x) 



Choose 5 = min{(5i,<52}; from ( |2"7) and ( |2"8) , we obtain 

V^(* + )<yV^(x)+p, 



(29) 



for all (x,e,d) e Ao, x £B x <SB satisfying x m = x + e e A™- 
We now define two complementary subsets of A M : Xj = {x e 
A M I V^(x) < ytz) and X 2 = {x e A M | V^jc) > yu), and we 
assume that p is not large enough that X2 is empty (otherwise 
the proof is simpler). For any (x, e, d) e Xi x 6M x 6M satisfying 
x m — x + e e A M , and F e d(x) C it follows from ( |2"9) that: 
V Q Np (x + ) < yp + (y - y)p < p. For any (x, e, d)eX 2 xSBx M 
satisfying x„, = x + e e and F e j(x) c it follows again 
from (|29j> that: V^(* + ) < yV Nfi (x) + (y-y)V Nfi (x) < yV NJ3 (x). 
Thus, for any (x, e,d) e Xx<5Bx<SB satisfying x m = x+e e A M , 
and F ec i(x) c Aco, we have established that d26) holds. □ 



We now define the set over which SRES is guaranteed. Con- 
sider the largest V € K>o such that for any p e (0, V) the set 



C p = \x e X a 



y Nfi {x) <V -p] satisfies C p c int(Aoo). 



Theorem 29. The origin of the perturbed closed-loop system 
( [23) is SRES on C p . 



Proof. (Robust recursive feasibility) We first prove that given 
any initial state x(0) e C p , there exists 6 e E>o such that 
([25a) holds, i.e. MPC 1 remains feasible at all times for per- 
turbation sequences satisfying ( |24) . Assume that x e C p , and 
choose 61 e (0,p/2). Thus, for any e e StB, it follows that 
x m — x + e e Cp/2 c int(A M ), and MPC 1 is feasible and 
yields a control Kp(x m ). Then, the nominal successor state is 
x + = Ax m + BKp(x m ). Given that any sub-level set of V^^(-) is 
forward invariant for the nominal closed-loop system, it follows 
that x + € Cp/2 c int(A<x,). Recalling that x + -x + = Ae-d, it fol- 
lows that there exists 62 > such that for any (e, d) e 62B x #28 
the condition x + e A™ holds true. We can now apply the result 
of Lemma 28 given any p < V - p, to obtain that there exists 



63 > such that the condition V^ J3 (x + ) < max{p, yV^ B (x)} < 



V - p holds true for any (x, e, d) e A M x 5 3 B x <5 3 B. Hence 
x + € C p c int(Aco). This part of the proof is completed by 



defining 6 = min{5i, 62, 5?,}. 



(Robust exponential stability) From Corollary 18 the exist pos- 

||2 ^ t/0 /„\ ^ n„i|2 

Nfi 

„2 



itive constants 71,72 such that: y\ ||x|| < V^(x) < y 2 \\x\\ 
Choose p = 7if 2 - Given a solution tfr e d(k; x) at time k, for the 



initial state x(0) = x, from Lemma 28 by induction we obtain 



that for any (x, e, d) e Aco x 6M x 6M the condition 

yiU e d(k;x)\\ 2 < V^GM*;*)) < max{/^(x),p} 

< maxf^HxH 2 ,^} < max{ r ' : 72lkll 2 ,7if 2 ) 
holds true (if necessary we can reduce 5). This implies that: 

Wed(k;x)\\ < max{fcr*|W|,e} < b/M + e, 
for b = -^72 /71 and A = -^7 e (0, 1). 



□ 



5. Numerical implementations 

Problems ( fT6) and ( [TT) are not posed as standard QP prob- 
lems. However, we have the following results. 

Proposition 30. For any £ e R>o 

[x e W I V p (x) < = (ie W \ Fx < gl\ . 

Proof. 

\2 



V p (x) = (max(Fx)Y = ^maxF,;cj < ^ o 

max{F,x) < f o VieI r »Fi<fl. □ 

Proposition 31. 77je nonlinear optimization problem ( |16) 
/s equivalent to the QP problem 

¥ N (x) : min ^(x, u, £) s.fc u e 1/^(x), f e [0, 1] 



F0(JV;jc,u)<^l r) (30) 



having cost function 

V Nfi (x,u,f) = Bf + J]{t(x(k),u(k))}. (31) 



2V-1 



fc=0 



Proof. Problem ([16) can be reformulated as 

min ^(x, u, £) s.t. u € ^(x), Vp(0(AT; x, u)) < ^ 2 



with cost function VjVjgCJC, u, £) in ( [31) . The QP formulation ( [30) 
is finally recovered in view of Proposition 30 □ 



Remark 32. In Proposition^!^ "equivalent" is intended in the 
following sense: the optimal values of P^, ([16) and P^,(x) ( |30| > 
are the same, and if u2(jc) solves ([16) ant/ (u^(x), solves 
P N (x) (f30), r/;en u°(x) = u«(x). 



Proposition 33. The nonlinear optimization problem Pi ( |17[ > 
/i equivalent to the QP problem 

f A N (x): minViv^u) s.t. ue'Mj(i), 

F (Ax + Bu(l)) < Amax(Fx)l r (32) 



7 



Proof. The nonlinear constraint ( |T7] > is equivalent to the linear 
one F {Ax + Bu{\)) < A max(Fjc)l_ r in view of Lemma|4] □ 

Remark 34. MPC lb can also be formulated as a QP problem 
P0[ ) with B = B*(x). In MPC lb, the price to pay for using 
the "lowest but still safe" weight /3*(x) ( |19[ ) is the online com- 
putation of A* (x) from dTll, that could be even more demanding 
than the QP ( |30| > itself. Nonetheless, problem |7} can be solved 
off-line for a finite number of polyhedral level sets ofV p (-), thus 
providing a look-up table for A* (x), and so for B* (x), depending 
on the "polyhedral annulus" the current x belongs to. 

6. Application examples 

While we proved that the proposed MPC algorithms guar- 
antee ES on the maximal controlled domain of attraction, in the 
examples presented in this section we heuristically show that 
they can also lead to "good" closed-loop performances, even 
with short prediction horizons. 

In the examples, the maximal controlled set Xoo is numer- 
ically computed according to 11221 . with a tolerance e and so 
with guaranteed contraction A — 1 - e. The set X/ is chosen 
as in ( fTTj ), and in the computations of the DoA for conventional 
QCLF-based MPC, Xff, the terminal set X/ is approximated 
with a polytope of 1000 vertices. Also the set Xn p2"| i is com- 
puted numerically for comparison, although it is not required 
for implementation of MPC la. In both examples, the predic- 
tion horizon of the presented MPC algorithms is fixed toN -2, 
and the cost matrices are chosen as Q — I and R = 0.17. 

6.1. Example 1 

The first example is the open-loop-unstable system 



1.1 
0.2 1.1 



x + 



0.1 0.1 
0.1 



11. 




Figure 1: Example 1: sets Xy (blue), Xn (cyan), Kn (red), Xoo (green). 



Table 1 : Performance cost of the proposed MPC algorithms, normalized with 
respect to the optimal one. Results are obtained averaging over 20 simulations 
starting from initial conditions taken close to the boundary of X m ■ 





MPC 1 


MPC la 


MPC lb 


MPC 2 


Example 1 


1.035 


1.026 


1.024 


1.034 


Example 2 


1.065 


1.058 


1.004 


1.031 



Aq = 1, c = 1, A R = 0.1, a 3 = (1 - A 2 )a x = (1 - (1 - 10- 3 ) 2 )0.7, 
namely B = B* = 786.1. In MPC lb, f3*(x) varies from B* = 
786.1 for x close to the boundary of Xoo to about 1.6 for x close 
to the origin. We note that the proposed MPC algorithms lead 
a performance that is only 3 - 4% worse than the optimal one 
(resulting from solving P N ( fT0] i with horizon N = 120). 

6.2. Example 2 

Consider the open-loop-unstable system 



1.0250 
0.0250 



0.0125 
1.0500 



x + 



0.05 





0.05 



The constraint sets are 



which is a discrete-time counterpart of the system simulated in 
132, Sec. 4]. The constraint sets are 



X = {x£R 2 | |WL<1}, 

U = {(mi, ui) e R 2 | ui e [0, 1], u 2 e [-1, 1]}. 

The set of admissible controls U has the origin in its boundary, 
because of the constraint u\ > 0. As a consequence, the set 
X/ associated to the Riccati-optimal quadratic shape reduces 
to origin. In order to avoid this, see ll25l l26l . P is chosen as 
the solution of the ARE associated to the matrices A, B 2 (the 
second column of B), Q and R 22 (element in position (2,2) of 
matrix R). Then, Xy = \x e R 2 \ x T Px < a} is chosen as the 
largest set of the kind made controlled-invariant by u(x) = Kx, 

with K - - [B T 2 PB 2 + ^2,2) 1 B T 2 PA. 

We numerically compute the set Xoo with a tolerance e = 
10~ 3 . Notice that the asymmetry of U induces sets Xn, X^, Xoo 
to be asymmetric, as shown in Figure [T] Closed-loop simula- 
tions are performed for 120 steps. The results for the closed- 
loop performance cost, averaged over 20 simulations with ini- 
tial state close to the boundary of Xca, are shown in Table[T] In 
MPC 1 and MPC la, B is chosen according to Lemma [TT[ with 



= \x £ 



IWL<i}. u = { MG : 



< i}- 



The set Xoo, shown in Figure [2] along with X/, Xn and X^, 
is computed with a tolerance e = 10~ 2 . Closed-loop simulations 
are performed for 100 steps. The results (again averaged over 
20 simulations with initial state close to the boundary of Xoo) 
for the closed-loop performance cost are shown in Table [T] In 
MPC 1 and MPC la, B is chosen according to Lemma [TTpwith 
I Q = l,c= 1,I« = 0.1, a 3 = (l-A 2 )ai = (1 -(1 - lO^O^, 
namely B = B* = 122.8. In MPC lb, B*(x) goes from B* = 
122.8 for x close to the boundary, to about 2.4 for x close to the 
origin. All algorithms, using N - 2, lead to a performance that 
is at most 5 - 6% worse than the optimal one (resulting from 
solving P/v ( [Tol l w i m horizon = 100). We also notice that 
MPC lb is only 0.4% worse than the optimal control. 

6.3. Further discussion on numerical results 

As expected, MPC 1 a induces a better closed-loop perfor- 
mance with respect to the one of MPC 1. In fact, unlike MPC 1, 




x l 



Figure 2: Example 2: sets X/ (blue), Xn (cyan), Xn (red), X m (green). 

in the set Xn MPC la switches to the optimal control, be- 
cause the prediction x N e Xy is obtained without imposing 
a terminal constraint. On the other hand, from our numer- 
ical experience, if A is quite close to 1, then the constraint 
max(F<p( 1 ; x, u)) < A max(Fx) in the optimization problem Pi 
( fTTj ) is usually not active for x close to the origin. In such cases, 
problems ¥ N (x) ( fTT) and Pn( x ) ( fl8| ) have the same solution. 
As a consequence, MPC 2 (and also its dual-mode counter- 
part) would show similar performance. Finally, as expected, 
the closed-loop performances of MPC 1 is always improved by 
MPC lb because p*{x) < {3 = /?* . As a matter of fact, MPC lb 
led to the best performance in all examples we tested. 

7. Conclusions 

Polyhedral control Lyapunov functions (PCLFs) can shape 
the maximal (robust) domain of attraction (DoA) of constrained 
linear systems. We exploit such property to propose novel MPC 
formulations that guarantee the maximal controllable set, inde- 
pendently of the chosen finite horizon. This result is achieved as 
the terminal constraint region is set to be equal to the maximal 
controllable set, which can be parameterized as the sub-level 
set of a suitably defined PCLF. Closed-loop exponential stabil- 
ity of the origin is ensured either by a suitably "inflated" PCLF- 
based terminal penalty or by adding a one-step-ahead contrac- 
tion constraint of the PCLF shaping the maximal DoA. Two 
variants were proposed, one based on a dual-mode formulation 
and one based on a state-dependent terminal weight. Moreover, 
the infinite-horizon optimal cost is achieved for a well defined 
subset of the maximal DoA, and inherent robustness with re- 
spect to arbitrary sufficiently small perturbations is proved. 

Achieving the maximal DoA irrespectively of the predic- 
tion horizon is an important goal because it allows the compu- 
tational burden, related to the use of long horizons, to be sepa- 
rated from issues of controller's feasibility and closed-loop sta- 
bility. Therefore the horizon only affects the closed-loop per- 
formance. Numerical examples showed that the DoA of the 
proposed formulations is much larger with respect to that of 
conventional MPC formulations for short horizons, and hence 
a great benefit in terms of feasibility is obtained. In these ex- 
amples, the closed-loop cost obtained with the proposed for- 
mulations is quite close to that of the infinite-horizon optimal 
controller even if very short horizons are employed. This can 



be very attractive in cases where a long horizon cannot be used 
due to limited computational time, for instance in fast dynamic 
systems. Future work will examine closed-loop nominal and 
robust performance from a theoretical point of view. 
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